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Abstract 

This mixed method study explored the professional competencies that 
administrators expect from entry-, mid-, and senior-level professionals 
as reflected in 1,759 job openings posted in 2008. Knowledge, skill, and 
dispositional competencies were identified during the qualitative phase of 
the study. Statistical analysis of the prevalence of competencies revealed 
significant differences between major functional areas and requirements 
for educational and work experience. Implications for institutional leaders, 
graduate faculty, and professional development planning as well as for 

mixed methods research are discussed. 


AUTHORS 

John L. Hoffman, Ph.D. 
California State 
University, Fullerton 


Marilee J. Bresciani, Ph.D. 
San Diego State University 

CORRESPONDENCE 

Email 

jhoffman@fullerton.edu 

AUTHORS’NOTE 

The authors wish to thank 
The Placement Exchange 
and its supporting professional 
associations for providing the 
data for this study. The authors 
additionally thank Chieh-Hsing 
Chou and Michelle Cuellar for 
their assistance with coding 
the data. 


• *. 

26 •RPA 

M 


Identifying What Student Affairs Professionals 
Value: A Mixed Methods Analysis of Professional 
Competencies Listed in Job Descriptions 




a 

hen situations change on a dime, as is frequently the case in today’s econo¬ 
my, people are what make a difference” (Whitely, as cited in Grund, 2009, p. 12). The 
student affairs profession values people, and in an era of assessment and accountability, 
it must also be a profession that values the development and demonstration of compe¬ 
tence by those people. Palomba and Banta (1999) defined assessment as “the systematic 
collection, review, and use of information about education for the purpose of [emphasis 
added] improving student learning and development” (p. 4). Closing the assessment loop 
from data collection and analysis to improving learning and development often entails 
changes in the design and delivery of educational programs, but this effort should also 
consider the knowledge, skills, and dispositions of the educators who enact those pro¬ 
grams. For this reason, assessment-minded scholar-practitioners have recently afforded 
increased attention to the question of what specific competencies successful student af¬ 
fairs professionals need. The research and professional literature addressing this question 
has largely emphasized new professional competencies and relied on self-reports from 
senior student affairs officers, mid- and entry-level professionals, and graduate prepara¬ 
tion faculty. Though Pace (1985) suggested that self-report data in well-designed studies 
are valid, Brener, Billy, and Grady (2003) have shown that cognitive and situational fac¬ 
tors may influence participant self-report responses. Thus, it is important to triangulate 
self-report data with additional measures of the phenomenon in question. 


The purpose of this exploratory mixed methods study is to extend current litera¬ 
ture addressing the self-reported competencies required of entry-, mid-, and senior-level 
student affairs professionals by examining which competencies college and university 
administrators include in formal job postings. While we acknowledge that the content of 
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job postings is often politically negotiated between competing campus interests, influenced 
by campus culture, or tempered by human resource professionals who wish to avoid poten¬ 
tial litigation, we also assert that job postings are a meaningful reflection of the competen¬ 
cies college and university administrators desire from the professionals they hire. Further, 
we stress both the functional and the symbolic importance of the content of job postings. 

Functionally, the content of job postings provide an initial indicator to prospective candi¬ 
dates of the outcomes that institutions will expect of them as well as of the competencies 
that administrators believe will be necessary to achieve those outcomes. Symbolically, job 
postings present a first impression of the underlying institutional values that will guide the 
desired means of accomplishing outcomes. Thus, the findings of this study should inform 
not only the work of the preparation programs and professional development organiza¬ 
tions that help student affairs professionals to develop the competencies necessary to be 
successful, it should also inform the work of the leaders who design job postings and their 
associated job descriptions. 

To address the study’s purpose, the researchers posed these research questions: 

(a) Which competencies do college and university administrators most frequently 
include in formally advertised job postings? (b) Which competencies are more or 
less often required of student affairs professionals within various functional areas? 

(c) What differences exist in competency requirements between major functional 
areas, different types and sizes of institutions, and positions requiring different 
levels of education and work experience? 

Literature Review 


Our framework for this study considered both the scope and development of 
competencies through education and professional experience. Standards developed by 
the American Psychological Association (APA), the Council for Accreditation of Counsel¬ 
ing and Related Educational Programs (CACREP), and the National Association of Social 
Workers (NASW) emphasize knowledge and skills. Because the scope of student affairs work 
includes leadership and educational functions as well as advocacy and helping roles, we 
chose to also consider dispositional competencies. The literature addressing dispositions is 
grounded in works such as Coleman’s (1995) model of emotional intelligence and Perkin’s 
(1993) work addressing the interconnections between neurological, experiential, and 
reflective intelligence and spans both education and leadership studies (e.g. Avolio, 2010; 
Bass & Riggio, 2005; Leithwood, Seashore Louis, Anderson, & Wahlstrom, 2004). For the 
purpose of this study, we defined dispositional competencies as encompassing “attitudes, 
values, and beliefs” (NCATE, 2008, p. 80) and “habits of the mind...that filter one’s knowl¬ 
edge, skills, and beliefs and impact the action one takes in professional settings” (Thorn¬ 
ton, 2005, p. 62). 


Symbolically, job postings 
present a first impression 
of the underlying insti¬ 
tutional values that will 
guide the desired means of 
accomplishing outcomes. 


To address the evaluation and development of competencies, we drew upon the 
five stages of the skill acquisition model developed by Dreyfus and Dreyfus (1980). Move¬ 
ment through the various stages is marked first by a shift from following concrete rules 
(stage one, novice) to identifying recurrent patterns or aspects {competence). In the third 
stage, proficiency, professionals move beyond aspect recognition to evaluating aspects in 
the context of various situations. Professionals next demonstrate expertise when intuition 
replaces aspect recognition and evaluation. Finally, the fifth stage of mastery is marked by a 
degree of transcendence of expertise. 


Identifying Competencies 

American College Personnel Association (ACPA) and National Association of Stu¬ 
dent Personnel Administrators (NASPA; 2010) recently published a set of 10 professional 
competency areas for student affairs professionals. Their work built on prior sets of com¬ 
petencies identified by the Counsel for the Advancement of Standards in Higher Education 
(CAS, 2006) and ACPA (2008), as well as numerous empirical studies. This work, officially 
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Current competency 
research is largely limited 
to expectations for new 
professionals, but not 
those for mid- or senior- 
level professionals who 
should be able to demon¬ 
strate skill acquisition at 
a more advanced level. 
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adopted by ACPA and NASPA governing boards, extends prior discussions of professional 
competence by providing outcomes and descriptions of each competency area that were 
“divided into basic, intermediate, and advanced levels that delineate the increasing complexity 
and ability that should be demonstrated by practitioners as they grow in their professional 
development” (ACPA & NASPA, 2010, p. 4). The 10 competency areas are (a) advising and 
helping, (b) assessment, evaluation, and research, (c) equity, diversity, and inclusion, (d) 
ethical professional practice, (e) history, philosophy, and values, (f) human and organiza¬ 
tional resources, (g) law, policy, and governance, (h) leadership, (i) personal foundations, 
and (j) student learning and development. 

Several recent research studies have also aimed to identify sets of professional 
competencies that entry-level professionals should possess. Lovell and Kosten (2000) 
conducted a meta-analysis of 30 years of research in order to identify 16 broad knowledge, 
skill, and personal trait characteristics that were vital to success in the student affairs pro¬ 
fession. Their competencies were similar to those recently generated by ACPA and NASPA, 
though they did not include competencies in the areas of equity, diversity, and inclusion; 
ethical professional practice; or history, philosophy, and values. Burkard, Cole, Ott, and 
Stoflet (2005) employed a Dephi design involving multiple iterations of surveys with a 
panel of 104 mid- and senior-level student affairs administrators. The 32 competencies 
identified by Burkard et al. aligned well with the ACPA and NASPA competencies, though 
they did not include any competencies in the areas of ethical professional practice or his¬ 
tory, philosophy, and values. These competency areas did materialize in a recent study by 
Hickmott and Bresciani (in press) who classified the 26 competencies that emerged from 
their study as knowledge, skills, or dispositions. In this study, ethical practice was included 
with the legal knowledge competency. The Hickmott and Bresciani study differed from 
those conducted by Lovell and Kosten and Burkard et al. in that they employed a grounded 
theory approach to analyze formal documents from 54 graduate preparation programs. 
Thus, competencies related to ethical professional practice and history, philosophy, and 
values emerged from the study that examined graduate program documents but not from 
those that examined prior research (Lovell & Kosten, 2000) or the self-reports of mid- and 
senior-level practitioners (Burkard et al., 2005). 

Development and Evaluations of Competencies 

Additional research has endeavored to assess faculty and administrator percep¬ 
tions regarding the degree to which entry-level professionals have mastered essential 
competencies. Herdlein (2004) administered a mixed methods survey to a sample of 48 se¬ 
nior student affairs officers (SSAOs) who worked at colleges and universities with student 
affairs graduate preparation programs. Herdlein found that SSAOs were generally satisfied 
with the level of new professional competence, and that they rated new professionals high¬ 
est in the areas of overall knowledge of higher education, knowledge of student develop¬ 
ment theory, and skills in leadership, technology, and counseling. These SSAOs rated new 
professionals lowest in the skill areas of budgeting, strategic planning, and research and 
assessment, as well as in the knowledge areas of campus politics and legal matters. More 
recently, Herdlein, IHine, Boquard, and Haddad (2010) studied faculty perceptions of the 
importance of various learning outcomes for their programs. When responding to sur¬ 
vey items, the most highly rated learning outcomes were in the areas of (a) knowledge of 
student characteristics and the effects of college, (b) student development theory, (c) how 
values inform practice, and (d) multicultural perspectives. The lowest rated outcomes were 
for (a) teaching methods, (b) international education, (c) governance and public policy, 
and (d) research methods. When asked via an open-ended question to identify the course 
that was most important to professional practice, faculty listed student development and 
learning courses more than twice as often as any other course. 

Waple (2006) studied entry-level professionals themselves rather than SSAOs or 
faculty. Waple’s findings largely mirrored Ilerdlein’s (2004), though Waple found that new 
professionals rated themselves lower in several technology-related competency areas. Guyjet, 
Longwell-Grice, and Molina (2009) studied recent preparation program graduates and their 
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supervisors and found that graduates rated their knowledge acquisition higher than did their 
supervisors. Renn and Jessup-Anger (2008), however, found that assessing their own levels of 
competence and proving themselves were significant challenges for new professionals. 

Two additional studies sought to explore differences in the perceptions of SSAOs 
and faculty regarding entry-level competencies. Ivuk, Cobb, and Forrest (2007) analyzed 
survey responses from 60 SSAOs, 60 mid-level managers, and 60 faculty regarding the 
importance of 50 competencies that aligned with four broad clusters of knowledge and skill 
competencies. They found that faculty rated the importance of (a) individual practices and 
administration, (b) goal setting and the ability to manage change, and (c) managing organi¬ 
zations and groups significantly lower than did either SSAOs or mid-level managers; they 
found no differences for professional knowledge and content. Faculty were also more likely 
to expect entry-level professionals to master professional knowledge and content through 
coursework, though they expected them to learn how to manage organizations and groups 
in professional settings. Renn and Jessup-Anger (2008), in their grounded theory study of 
the experiences of entry-level professionals, found that new professionals desired greater 
support in managing the cultural dynamics of work environments. 

Dickerson et al. (2011) compared ratings by 125 faculty and 275 SSAOs of 51 dis¬ 
crete knowledge, skill, and dispositional competencies. They found no differences between 
SSAOs and faculty in the perceived importance of 49 competencies and no differences 
in assessments of the degree to which new professionals possessed 42 of the 51 compe¬ 
tencies. Dickerson et al. further examined differences between the degree to which the 
entire sample rated the competencies as “desired for” and “currently possessed by” new 
professionals. They found significant gaps in the areas of fiscal management, assessment, 
and knowledge of legal standards, findings that mirror those of Ilerdlein (2004) and Waple 
(2006). However, Dickerson et al. also found significant gaps for collaboration, conflict 
management, the application of theory to practice, and written communication, areas iden¬ 
tified as strengths among the Ilerdlein and Waple studies. 

To summarize, there appears to be emerging consensus within current research 
and professional literature regarding the scope of knowledge, skill, and dispositional com¬ 
petencies for entry-level professionals. However, this consensus largely reflects analyses of 
the self-reports by SSAOs, faculty, and other practitioners regarding these competencies, 
but not which competencies administrators include in job postings. Further, current com¬ 
petency research is largely limited to expectations for new professionals, but not those for 
mid- or senior-level professionals who should be able to demonstrate skill acquisition at a 
more advanced level. 


Methodology 

We drew from a pragmatic orientation to adapt what Creswell and Plano Clark 
(2011) described as an exploratory mixed methods research design. This design involves 
an initial qualitative data collection and analysis phase that informs subsequent quantita¬ 
tive data collection and analyses. In keeping with what Patton (1990) identified as a “mixed 
form design” and Tashakkori and Teddlie (1998) described as a “mixed model design,” our 
study involved a single data set that we initially analyzed using a qualitative approach. The 
results of the initial qualitative analysis were then analyzed using quantitative methods. 
This mixing of data analyses allowed us to extend the identification of competencies from 
the data set to an exploration of the prevalence of these competencies both within and be¬ 
tween groups inside the larger data set. The following provides an overview of the data uti¬ 
lized in this study. Because of the sequential nature of the study, we present the research 
design and results for each phase of the study separately. 

Data Collection and Sample 

The data for this study consisted of all 1,759 job descriptions posted through The 
Placement Exchange (TPE) in 2008. TPE is a partnership between NASPA, the Association 
of College and University Housing Officers-International (ACUHO-I), the National Associa¬ 
tion for Campus Activities (NACA), the Association for Student Judicial Affairs (ASJA), the 
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Table 1 

Institution and Job Characteristics 


Category 

N 

% 

Institution Type (n = 1,759) 

2-Year Institutions 

116 

6.6% 

4-Year Public Institution 

600 

34.1% 

4-Year Private Institution 

925 

52.6% 

Professional Organization/Other 

118 

6.7% 

Institution Size (n = 1,759) 

Under 5,000 

658 

37.4% 

5,000-9,999 

287 

16.3% 

10,000-20,000 

372 

21.1% 

More than 20,000 

442 

25.1% 

Job Category (n = 1,729)* 

Admissions and Enrollment Management 

45 

2.6% 

Career Services 

70 

4.0% 

Counseling, Health, and Wellness 

65 

3.7% 

Greek Life 

64 

3.6% 

Judicial Affairs 

50 

2.8% 

Multicultural (including lesbian, gay, bisexual/transgendered services, 

105 

6.0% 

and women’s centers) 

Orientation and New Student Programs 

63 

3.6% 

Residence Life 

797 

45.3% 

Student Activities (including leadership programs and student unions) 

232 

13.2% 

Student Affairs Administration 

405 

23.0% 

Other Student Affairs Positions 

150 

8.5% 

Highest Level Education Preferred or Required (n = 1,668)** 

Bachelor’s Only 

129 

7.8% 

Master’s Preferred 

611 

37.1% 

Master’s Required 

700 

42.5% 

Doctorate Preferred or Required 

208 

12.6% 

Years of Professional Experience Required (n = 1,422) 

0-3 Years 

779 

54.8% 

4-6 Y ears 

512 

36.0% 

7 or More Years 

131 

9.2% 

Note. 

*219 job postings were categorized under two or functional areas; thus, the cumulative 


percentages for this section exceed 100%. 

**The data for some job postings did not include highest level of education preferred or years of 


professional experience required. 


National Orientation Directors Association (NODA), the Association of Fraternity/Sorority 
Advisors (AFA), and IIigherEdJobs.com (www.theplacementexhange.org). TPE holds an 
annual placement conference prior to the national meeting of NASPA and serves as a cen¬ 
tralized online web source for student affairs job postings. Data collected for this set of job 
postings included the institutional type and size, job category, education and work experi¬ 
ence required of applicants, and the full text of the job postings (See Table 1). 

Assumptions and Limitations 

This single data set served as our source and therefore we assumed that the sample 
was representative of student affairs positions throughout the United States. In qualitative 
terms, these job postings served as a large data set that should contribute to reasonable 
external or “ecological” validity (see Gall, Borg, & Gall, 1996), meaning that we anticipated 
that a similar set of competencies would emerge from a grounded theory analysis of an 
alternate comprehensive set of student affairs job postings. Since there are no existing data 
that accurately break down the number of student affairs professionals employed national¬ 
ly at various types and sizes of institutions or in various functional areas, it was impossible 

• •« to compare this sample to the full population of student affairs jobs. 
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There are several limitations to our assumptions regarding the representativeness 
of the sample and to the external validity of findings. The data were collected in 2008, just 
prior to a significant economic downturn and shortly following the publication of the Spell¬ 
ing’s Report (U.S. Department of Education, 2006). This, along with other socio-historical 
factors likely influenced the content of some job postings; one should use some caution, for 
example, in assuming that job postings advertised during the economic downturn would 
reflect the findings of this study. Further, a visual review of Table 1 reveals that positions 
within community colleges were underrepresented, as were positions within the functional 
areas of admissions and enrollment, academic advising, outreach, and financial aid. Ad¬ 
ditionally, there was significant variation in the content, length, and detail of information 
included in job postings and descriptions. We assumed that these variations, which are a 
form of measurement error, were randomly distributed across the large sample of data. 

Identifying Competencies 


For the initial phase of the study, we employed an adaptation of open and substan¬ 
tive coding to identify categories of competencies that were emergent within the data set 
(see Morse, 2009). Because our first research question aimed to identify competencies but 
not to explore the interrelationships between them, we utilized only open and substantive 
coding processes. We delimited the open coding process to the first 100 job postings in the 
data set and used these data as the basis for identifying competency areas. 

Twenty-three job competency categories emerged from our initial analysis and clustering of 
codes. Drawing from the job postings associated with each category, we generated defini¬ 
tions for each competency area and then used these definitions to re-code the entire data 
set of 1,759 job postings. For this final re-coding, we used whole job postings as the unit 
of analysis; in effect, we assigned a yes or no dummy code for each of the 23 competency 
areas to every job posting. We then reviewed frequencies to ensure discriminant validity 
between the various competency areas. As there was more than 90% overlap among the job 
postings coded as “assessment,” “program evaluation,” and “research,” we collapsed these 
three into a single competency category. Table 2 summarizes the emergent definitions and 
frequency counts for each of the final 21 competencies. 


Knowledge of the 
profession’s history and 
philosophy emerged as a 
stand-alone competency 
in this study, a finding 
that suggests that this 
competency is important 
to more than just faculty. 


Table 2 

E me rgen t Co mp etency Are* 
Competency 
Programming 
Communication 

Assessment, Evaluation, 
and Research 

Teaching and Training 
Leadership 
Budgeting and Fiscal 
Management 

Collaboration with Non- 
Faculty Professionals 
Collaboration with 
Faculty 

Law and Policy 

Diversity and Social 
Justice 

Technology 

Student Learning and 
Development 

Practical Competence 

Advising Groups 
Crisis Management 
Attitudes and Dispositions 

Advising Individuals 
Conflict Mediation 

Foundations of the 
Profession 

Fundraising 
Critical Thinking 


Definition Frequency 

This consistedof requirements to design, develop, implement, or manage programs, activities, and other forms of learning interventions. 1,139 

This encompassed both written and oral forms of communication as well as interpersonal communication. 1,038 

This area included all references to outcomes-bascd assessment, program review and evaluation, research, and data analysis. 846 

This involved teaching credit-bearing and non-credit courses as well as providing various forms of training. 756 

This encompassed efforts to provide long-term direction to divisions or departments including planning, forecasting, and visioning. 753 

This included all references to understanding and managing budgets, financial plans, and fiscal resources. It didnot include fundraising. 736 

This involved requirements forteamwork, partnership, or collaboration that specifically cited non-faculty professionals on the campus. 693 

(Collaboration with faculty was also citedin480,69.3%, ofthese postings.) 


This included requirements for teamwork, partnership, or collaboration specifically with faculty. (Collaboration with non-faculty was also 649 
cited in479,73.8%,ofthese postings.) 


This consisted of knowledge of higher education law, oversight of disciplinary procedures, development and administration of policy, and 615 
understanding governance structures. 

This entailed required knowledge, skill, or dispositional competencies necessary to work with divase students or to create inclusive 600 

learning environments. This extended beyond mere descriptions of working in a diverse environment or identification of the institution as 
an equal opportunity employer. 

This consisted of all requirements to use computers and otha forms of technology. 589 

This included required knowledge of student development or learning theory and skill-based expectations to apply these in practice. 552 

This consistedof an array of skills related to time management, organizational skills, managing multiple responsibilities, working 423 

autonomously, and meeting deadlines. 

This encompassed requirement for any form of advising student clubs, organizations, or groups of students. 318 

This included all requirements to respond to emergencies, assess risks, or manage crisis situations. 318 

This covered broad requirements for dispositional competencies; the most common were creativity, enthusiasm, flexibility, and a positive 252 
attitude. 

This encompassed requirements for providing any form of advising or counseling to individual students. 210 

This included requirements for mediating conflicts between individuals or groups of students. 174 

This entailed all requirements for knowledge of the history, philosophy, or ethical standards of student affairs or higher education. 100 

This included requirements to engage in grant-writing, organize fundraising events, and solicit donations. 60 

This encompassed requirements for problem-solving, decision-making, critical thinking, and reflective practice. 56 


Percentage 
64.8% 
59.0% 
48.1% 

43.0% 

42.8% 

41.8% 

39.4% 

36.9% 

35.0% 

34.1% 

33.5% 

31.4% 

24.0% 

18.1% 

1 8. 1 % 
14.3% 

11.9% 

9.9% 

5.7% 

3.4% 

3.2% 
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Testing for Differences 

For the second phase of the study, we constructed a series of cross-tabulation 
(crosstab) tables to compare the frequencies within various functional areas as well as 
between functional areas, institutional types and sizes, and sets of required education and 
work experience. In what follows, we review the specifics of our research design followed 
by the results for each research question sequentially. 

Differences within Functional Areas 

To examine differences within the various functional areas, we first delimited the 
sample to the 1,540 job postings categorized in only one functional area. Given 21 compe¬ 
tency areas (each coded yes or no) and 11 functional areas (coded yes or no), this yielded 
231 2x2 crosstab tables. We used Fisher’s exact test to check for differences and Phi to 
test for effect size. The null hypothesis for Fisher’s exact assumes that the prevalence of 
yes and no values for each competency area will be divided proportionally across each of 
the 11 functional areas. When statistically significant, we rejected the null hypothesis and 
assumed that there were differences in the prevalence of the competency for the given 
functional area. In those instances, we further calculated Phi to examine the effect size of 
the differences. Phi is a symmetric measure that determines the effect size of differences 
in 2x2 crosstab tables. Cohen (1988) placed Phi (along with the other symmetric measures 
used in this study) into the same family of statistics as the more common Pearson’s r mea¬ 
sure of correlation; thus, one should interpret the Phi statistic in a similar manner as one 
would interpret a Pearson’s r. 

Table 3 reviews the results of tests of differences within each of the functional 
areas. Because non-parametric measures are sensitive to sample size, one should not 
compare Phi values between two different functional areas. The Phi values are an accurate 
measure of the effect size for differences within each of the functional areas. While there 
were many statistically significant differences in competency prevalence within the vari¬ 
ous functional areas, the effect size of these differences were generally small or quite small. 
According to Cohen (1988), effect sizes for Phi that are less than .10 are much smaller than 
typical for the social sciences; those between .10 and .30 are small. 

Differences between Groups 

Our third research question addressed differences between various functional 
areas, between different types and sizes of institutions, and between positions requiring 
different levels of education and work experience. To compare the effect size for differ¬ 
ences between various functional areas using non-parametric statistics, one needs to have 
sufficient numbers within each of the comparison groups, and there should not be any 
large fluctuation in the sample sizes of the groups. Given the large sample size differences 
for each of the functional areas, it was impossible to run comparative data without heavily 
weighting the data, which would significantly increase the likelihood of Type 1 measure¬ 
ment error. For this reason, we limited comparative analyses to institutional type, institu¬ 
tional size, and the levels of education and work experience required. 

Differences by institutional type. In order to test for differences between 
institutional types, we first delimited our sample to 2-year, 4-year private, and 4-year pub¬ 
lic institutions (n=l,641) and then weighted the data for the purpose of comparison. The 
result was 21 2x3 tables, one for each competency; each table analyzed the competency 
(yes or no) against the three institution types (2-year, 4-year private, or 4-year public). For 
2x3 tables with nominal data, the chi-square is the appropriate non-parametric test of dif¬ 
ference and Cramer’s V is the preferred symmetric measure. 

A few statistically significant differences emerged in the comparisons by institu¬ 
tional type. Two-year institutions were more likely to include requirements for collabora¬ 
tion with other professionals, x2(2) =49.36, p < .001; V = .13, p < .001; but less likely to 
include competencies related to crisis management, X2(2) =57.67, p < .001; V = .15, p < 
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Table 3 


Differences Within Functional Areas 


Functional Area'Competency 

Fisher’s Exact Test Sig. 

Phi Value 

Phi Sig. 

Admissions/Enrollment Management (n=30) 

Techno bgy 

.00 

.08 

.00 

Advising Groups 

.00 

-.07 

.01 

Crisis Management 

.00 

-.07 

.01 

Student Learning and Devebpmert 

.00 

-.09 

.00 

Teaching and Training 

.00 

-.12 

.00 

Career Services(n = 55) 

Advising Individuals 

.00 

.16 

.00 

Techno fogy 

.00 

.14 

.00 

CoDaboraion with F acuity 

.00 

.08 

.00 

Communicatfon 

.00 

.07 

.00 

Crisis Management 

.00 

-.09 

.00 

Law and Policy 

.00 

-.12 

.00 

Counseling/Health/Wellness (n = 40) 

Advising Gro ups 

.00 

-.07 

.01 

Greek Life (n= 47) 

Advising Gro ups 

.00 

.18 

.00 

Judicial Affeirs (n= 26) 

Conflict Mediatfon 

.00 

.09 

.00 

Law and Policy 

.00 

.09 

.00 

Teaching and Training 

.00 

.09 

.00 

Assessment, Evaluaion, and Research 

.01 

.07 

.01 

Budgeting and F is cal Management 

.01 

-.07 

.01 

Multicultural Services (n = 63) 

Diversity and Social Justice 

.00 

.12 

.00 

Fundraising 

.00 

.11 

.00 

Crisis Management 

.00 

-.08 

.00 

Law and Policy 

.00 

-.09 

.00 

Residence Life/Housing (n= 720) 

Crisis Management 

.00 

.24 

.00 

Conflict Mediatfon 

.00 

.14 

.00 

Law and Policy 

.00 

.09 

.00 

Advising Gro ups 

.00 

.08 

.00 

Foundations oftheProfession 

.01 

-.07 

.00 

Programming 

.00 

-.08 

.00 

Leaders hp 

.00 

-.10 

.00 

Teaching and Training 

.00 

.13 

.00 

Col a bora ion with F acuity 

.00 

-.11 

.00 

Communicatfon 

.00 

-.13 

.00 

Techno bgy 

.00 

-.13 

.00 

ColaboraionwithOlhcr Professionals 

.00 

-.14 

.00 

Budgeting andFiscal Management 

.00 

-.15 

.00 

Assessment, Evaluaion, andRescach 

.00 

-.16 

.00 

Fundrais ing 

.00 

-.16 

.00 

Student Activities (n= 158) 

Advising Gro ups 

.00 

.15 

.00 

Budgeting andFiscal Management 

.00 

.09 

.00 

Fundrais ing 

.01 

.08 

.00 

Communicatfon 

.01 

-.07 

.00 

Conflict Mediatfon 

.00 

-.09 

.00 

Diversity and Social Justice 

.00 

-.10 

.00 

Crisis Management 

.00 

-.11 

.00 

Colaboraion with F acuity 

.00 

-.12 

.00 

CoDaboraion wihOflier Professionals 

.00 

-.14 

.00 

Student Affairs Administraionfn = 287) 

Leadership 

.00 

.18 

.00 

Budgeting and F is cal Management 

.00 

.16 

.00 

Colaboraion with F acuity 

.00 

.16 

.00 

Colaboraion with Oflier Professionals 

.00 

.15 

.00 

Diversity and Social Justice 

.00 

.11 

.00 

Communication 

.00 

.10 

.00 

Foundations oftheProfcssfon 

.00 

.09 

.00 

Fundraising 

.01 

.08 

.00 

Assessment, Evaluaion, andRescaxh 

.01 

.07 

.01 

Advising Individuals 

.01 

-.07 

.01 

Advising Gro ups 

.00 

-.16 

.00 

Teaching and Training 

.00 

-.17 

.00 

Other Student Affairs Positions ( n- 77) 

Fundraising 

.00 

.12 

.00 

Techno bgy 

.00 

.10 

.00 

Communicatfon 

.01 

.07 

.01 

Advising Gro ups 

.00 

-.07 

.01 

Crisis Management 

.00 

-.08 

.00 


Note. Table 3 lists competency areas that werestotisticallysignifteantat/7<.01 listed from most commontoleast common according to Phi values 
(positiw Phi values indicate that the competency was more likely to occur within the functional area; negative Phi values indicate die oppo site) 


.001; teaching and training, x2(2) =53.69, p < .001; V = .14, p < .001; group advising, X2(2) 
=89.54, p < .001; V = .18, p < .001; and individual advising, X2(2) =55.34, p < .001; V = .14, 
p < .001. Private 4-year institutions were more likely than public 4-year institutions to in¬ 
clude requirements within these latter two advising competency areas, as well as in conflict 
mediation, X2(2) =30.86, p < .001; V = .11, p < .001. 

Differences by institutional size. For institutional size, we did not weight the 
data because each group had at least 200 cases and there were minimal sample size differ¬ 
ences between the groups. The result was 21 2x4 tables, one for each competency; each 
table analyzed the competency (yes or no) against the four institution size groups (less 
than 5,000; 5,000-9,999; 10,000-20,000; or more than 20,000). Given 2x4 crosstab tables 
with ordinal data, we used the chi-square to test for differences and Kendall’s tau-b to 
examine effect sizes. Few statistically significant results emerged from these analyses. The 
most significant difference was for the attitudes and dispositions competency, which was 
slightly more prevalent at smaller institutions, X2(3) =17.58, p < .01; tau-b = -.09, p < .001. 
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Differences by level of education. Though we were unable to classify the 
various job postings as entry-level, mid-level, or senior-level, the requirements for educa¬ 
tion and work experience afforded us a proxy to examine differences along a range of posi¬ 
tions extending from entry-level to senior-level. For education requirements, we organized 
the 1,648 positions that included education requirements into 21 2x4 crosstab tables, one 
for each competency; each table analyzed the competency (yes or no) against the four lev¬ 
els of required education (bachelor’s only, master’s preferred, master’s required, or doctor¬ 
ate preferred/required). We used the chi-square to test for differences and Kendall’s tau-b to 
test the effect size. Table 4 presents the results of these analyses. Not all tau-b values were 
statistically significant; this reflects instances where there were differences among the four 
groups that do not reflect the ordinal progression of the four educational levels (e.g. when 
a competency was more prevalent among the master’s required and preferred groups than 
either the bachelor’s only or the doctorate preferred/required group). We listed the compe¬ 
tency areas in Table 4 in rank order from those positions requiring the most education to 
those requiring the least. 


Table 4 


Differences Between Positions Requiring Different Levels of Education 


Competency 

Chi- 

Square 

Value 

(df=3) 

Chi-Square 

Significance 

Kendall’s 

tau-b 

Value 

Kendall’s 

tau-b 

Significance 

Leadership 

202.7 

.00 

.22 

.00 

Budgeting and Fiscal Management 

172.7 

.00 

.20 

.00 

Collaboration-Faculty 

100.8 

.00 

.15 

.00 

Assessment, Evaluation, and Research 

74.3 

.00 

.14 

.00 

Diversity and Social Justice 

47.1 

.00 

.09 

.00 

Collaboration with Other Professionals 

46.9 

.00 

.09 

.00 

Student Learning and Development 

28.6 

.00 

.08 

.00 

Law and Policy 

33.8 

.00 

.07 

.00 

Communication 

20.1 

.00 

.06 

.00 

Crisis Management 

41.3 

.00 

.05 

.00 

Foundations of the Profession 

33.6 

.00 

.05 

.01 

Fundraising 

32.2 

.00 

.05 

.02 

Conflict Mediation 

11.9 

.01 

.03 

.06 

Teaching and Training 

39.8 

.00 

-.01 

.53 

Advising Groups 

77.4 

.00 

-.06 

.00 

Advising Individuals 

24.1 

.00 

-.07 

.00 

Practical Competence 

39.0 

.00 

-.10 

.00 

Technology 

50.5 

.00 

-.11 

.00 


Note. Positive Kendall’s tau-b values indicate that the competency area was more prevalent for 
positions requiring higher levels of education; negative values indicate the opposite. 


Differences by level of work experience. We organized the 1,422 postings 
that included work experience requirements into 21 2x3 tables, one for each competency; 
each table compared the competency (yes or no) against the three levels of work experi¬ 
ence required (0-3 years, 4-6 years, or 7 or more years). We used the chi-square to test for 
differences and Kendall’s tau-b to test the effect size. Table 5 presents the results. We listed 
the competency areas in Table 5 in rank order from those positions requiring the most 
work experience to those requiring the least. 

Discussion 

Identifying Competencies 

The 21 competencies that emerged from this study aligned well with those gener¬ 
ated by ACPA and NASPA (2010), as well as with those identified by the empirical studies 
that informed the ACPA/NASPA publication (e.g. Burkard et al., 2005; Cuyjet et al., 2009; 
Herdlein, 2004). Interestingly, one could align three of the four most prevalent competen¬ 
cies in this study (programming, communication, and teaching and training) with ACPA/ 
NASPA’s “advising and helping” competency. As noted previously in the literature review, 
ethical practice - one of the ACPA and NASPA competencies - emerged only from the Ilick- 
mott and Bresciani (in press) study of graduate preparation curricula, and then only when 


34 ♦RPA Volume Seven I Summer 2012 






. RESEARCH if PRACTICE IN ASSESSMENT 


Table 5 


Differences Between Positions Requiring Different Lewis of Work Experience 


Competency 

Chi-Square 
Value (df=2) 

Chi-Square 

Significance 

Kendall’s 

tau-b 

Value 

Kendall’s 

tau-b 

Significance 

Leadership 

240.3 

.00 

.30 

.00 

Budgeting and Fiscal Management 

190.6 

.00 

.27 

.00 

Collaboration with Other Professionals 

107.0 

.00 

.20 

.00 

Collaboration with Faculty 

79.6 

.00 

.17 

.00 

Diversity and Social Justice 

49.3 

.00 

.13 

.00 

Assessment, Evaluation, and Research 

44.4 

.00 

.12 

.00 

Communication 

34.2 

.00 

.11 

.00 

Fundraising 

21.9 

.00 

.09 

.00 

Programming 

15.9 

.00 

.08 

.00 

Foundations of the Profession 

15.2 

.00 

.07 

.00 

Law and Policy 

23.4 

.00 

.07 

.00 

Technology 

8.4 

.02 

-.01 

.74 

Crisis Management 

15.9 

.00 

-.07 

.00 

Conflict Mediation 

17.7 

.00 

-.08 

.00 

Advising Individuals 

44.9 

.00 

-.12 

.00 

Teaching and Training 

109.6 

.00 

-.19 

.00 

Advising Groups 

151.8 

.00 

-.24 

.00 


Note. A positive Kendall’s tau-b value indicates that the competency area was more prevalent for 
positions requiring higher work experience; a negative value indicates the opposite. 


integrated with legal knowledge. It did not emerge from either the Lovell and Kosten (2000) 
or the Burkard et al. (2005) study, and it did not emerge as a stand-alone competency in this 
study. This finding highlights the fact that the findings of this study were descriptive, not pre¬ 
scriptive in nature. The fact that ethical practice did not emerge as an important competency 
area does not mean that it is not important for professionals or the profession. 

ACPA and NASPA’s history, philosophy, and values competency was also missing 
from the Burkard et al. (2005) study of mid- and senior-level perceptions and the Lovell 
and Kosten (2000) meta-analysis of prior practitioner research, though it did emerge in the 
Hickmott and Bresciani (in press) study of graduate preparation program documents. One 
might have interpreted this to mean that history and philosophy are more important to fac¬ 
ulty than to practitioners. However, knowledge of the profession’s history and philosophy 
emerged as a stand-alone competency in this study, a finding that suggests that this compe¬ 
tency is important to more than just faculty. Further, this competency was most commonly 
included among positions in student affairs administration that required higher levels of 
education and experience, which may reflect how knowledge of history and philosophy 
may contribute to practitioners’ capacities in aspect recognition and evaluation, processes 
associated with higher levels of skill acquisition in the Dreyfus and Dreyfus (1980) model. 

Developing and Evaluating Competencies 

When comparing the prevalence of these competencies within this sample to stud¬ 
ies that have aimed to rank the importance of competencies, several interesting differ¬ 
ences emerged. The studies by Burkard et al. (2005), Ilerdlein (2004), and Waple (2006) 
each identified sets of attitudes and dispositions, practical skills, and critical thinking skills 
among the most important or highly ranked competencies in their studies. However, criti¬ 
cal thinking (3.2%), attitudes and dispositions (14.3%), and practical competencies (24.0%) 
were among those least frequently included among the 2008 job postings. This may reflect 
hesitancy by human resource departments to include in job postings those competencies 
that are difficult to measure in selection processes or it may mean that these skill sets are 
assumed. Yet, if these skills are important and serve as criteria for future performance evalu¬ 
ations, administrators may be wise to negotiate for their inclusion in formal job postings. Fu¬ 
ture research could address this issue by triangulating job posting analyses with performance 
evaluation criteria or qualitative interviews with the administrators and human resource 
professionals who craft job postings, job descriptions, and performance evaluation protocols. 
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On the other end of the spectrum, colleges and universities included assessment, 
evaluation, and research competencies in 48.1% of 2008 job postings, but the related 
knowledge and skill competencies were ranked in the middle of the competency sets gener¬ 
ated by Waple (2006) and Herdlein et al. (2010) and near the bottom of the 32 competen¬ 
cies generated in the Burkard et al. (2005) study; they were not included at all among the 
34 traits identified as critical for success in the Herdlein (2004) study. This may reflect the 
growing importance of outcomes-based assessment and program review in student affairs 
and higher education particularly in light of the growing economic challenges and in¬ 
creased calls for accountability. Regardless of the reason, we find the increased prevalence 
in this study encouraging. We also suggest that competency in assessment, evaluation, and 
research is both germane to all functional areas, and it should be the work of all profes¬ 
sional educators on campus. Thus, we encourage leaders who design job postings and their 
associated job descriptions to more intentionally and systematically include assessment- 
related competencies in these important documents. 

Functional Area Differences 

Most of the differences within the various functional areas seemed intuitive, though 
there were a few surprises. As noted previously, the fact that there were statistically signifi¬ 
cant differences for a greater number of competencies within residence life, student activi¬ 
ties, and student affairs administration may reflect a broader set of desired competencies for 
these positions, but it may also reflect the sensitivity of non-parametric measures to sample 
size. Among the functional areas with smaller sample sizes, the fact that fundraising emerged 
as a more prevalent competency within multicultural services was noteworthy. This may re¬ 
flect the reality that multicultural services is often neither self-supporting, as is the case with 
residence life, nor supported by student fees, as is often the case with student activities. It 
may also reflect the growing availability of grants to support those services and programs and 
the understanding that these programs are desirable philanthropic venues for many donors. 
However, it may also be that some institutions or divisions of student affairs continue to view 
the work of multicultural services as more peripheral than central to their mission. In any 
case, we suggest that future studies explore why higher percentages of positions in multicul¬ 
tural services require fundraising competencies. 

In residence life, fundraising competencies were among the least prevalent along 
with assessment, evaluation, and research competencies, and the two collaboration-related 
competency areas. This is of interest since residence life has served as a common training 
ground for advancement in the student affairs profession, yet the competencies in the areas 
of collaboration, assessment, evaluation, and research, and fundraising were among the more 
prevalent required of student affairs administrators. Also common for student affairs admin¬ 
istration positions were the diversity and social justice competencies, a pattern matched 
only by the multicultural services functional area. We certainly do not question the value 
of residence life experience for advancement in the student affairs profession. That said, we 
note that many of the competencies most frequently required of student affairs administra¬ 
tors were also common within career services and multicultural services, which suggests that 
these areas may also serve well as training grounds for senior-level leadership. 

Competencies for Entry-, Mid-, and Senior-Level Professionals 

Several interesting differences emerged between job postings requiring different 
levels of education and work experience, our proxy for examining differences between 
entry-, mid-, and senior-level positions. It is important to note that Dreyfus and Dreyfus 
(1980) described advancements in “skill acquisition” in terms of shifts to more ambiguous, 
situational, holistic, and intuitive means of functioning. In light of this study’s findings, it 
appears that development of competence in some areas is cumulative, which is an assump¬ 
tion that is consistent with the Dreyfus and Dreyfus model and upheld by the NASPA/ACPA 
(2010) Professional Competency Area document. This seemed to be the case, for example, 
with the leadership and fiscal management competencies, which were most frequently in¬ 
cluded in job postings that required higher levels of education and experience. Other com- 



petencies, such as those related to the history and philosophy of the profession, may have 
greater utility as professionals advance to positions that require more situational, holistic, 
and intuitive ways of knowing (knowledge), functioning (skill), and being (disposition). 

Competency areas such as technology, practical competence, and advising were 
more prevalent among entry-level postings. In the case of the practical and technological 
competency areas, this may suggest that these are “gateway” competencies or it could as¬ 
sume that these are competencies that SSAOs delegate to their staff. Practitioners who do 
not master outcomes for these competencies at what ACPA/NASPA have described as the 
basic, intermediate, and advanced level may have limited capacity to advance to mid- and 
senior-level positions. For advising and training competencies, areas that are also more 
prevalent among entry-level positions, the cumulative level learning may work somewhat 
differently. One could argue that the skills developed in these competency areas are transfer¬ 
able to the areas of collaboration and leadership. Experience and professional development in 
advising and training may serve as a precursor to later development within the collaboration 
and leadership competency areas as well as serving as a prerequisite to career advancement. 
In light of the attention that AGPA and NASPA (2010) afforded to delineating “the increasing 
complexity and ability that should be demonstrated by practitioners as they grow in their 
professional development” (p. 6), we suggest that this progression and development of profes¬ 
sional competence is a topic worthy of further investigation. 

Implications 

Assuming that the scope and prevalence of competencies within advertised job 
postings reflect the values of administrators in terms of professional education, training, 
and development, there are important implications for graduate preparation programs and 
professional organizations, as well as for employers. We invite readers to question whether 
this listing would accurately represent what the profession values as a whole, albeit in 2008 
or beyond. In addition, we encourage practitioners to question where and when practitio¬ 
ners should master these competencies. 

Graduate preparation programs are important training grounds for new profession¬ 
als, and they are most effective when informed by quality standards (see Young & Janosik, 
2007). The results of this study, along with the findings of related studies, should inform 
graduate preparation faculty of the competencies that are most relevant to entry-level 
and mid-level professionals. For example, the importance of assessment, evaluation, and 
research and of student learning and development were each evident in this study. Bres- 
ciani (2010) has found that training for outcomes-based assessment is most effective when 
paired with training in student development theory. The findings here further suggest that 
the competency areas of individual and group advising, conflict mediation and teaching 
and training may be of particular importance for master’s level programs. Future studies 
should build on the work of Bresciani and the findings of this study to explore synergistic 
opportunities in training for multiple competency areas. 

The integration of training for multiple competency areas is likely even more im¬ 
portant for doctoral preparation programs and for those individuals who design and deliver 
professional development programs for mid-level and senior-level professionals. In these 
settings, educators should emphasize the development of more ambiguous, situational, 
holistic, and intuitive competency in the areas of leadership, budgeting and fiscal manage¬ 
ment, assessment, evaluation, and research, collaboration, and diversity and social justice. 
Hoffman and Bresciani (2010), for example, found a high co-occurrence of competency 
requirements in leadership, decision-making, collaboration, and teaching and training for 
assessment professionals working in student affairs. Paired with the findings of this study, 
the implication is that best practices for leadership training in student affairs are integra¬ 
tive and sequential. If we assume each competency area to be one that builds upon its 
expertise over time, then perhaps employers may also want to consider what competencies 
are required of the profession holistically and how they represent expected competencies 
in all of their position advertisements and at what level. For guidance in this area, employ- 
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ers may consider professional literature that is more definitive (i.e., AGPA & NASPA, 2010) 
than descriptive, as is the case for this study. 

We believe that student affairs is a profession that values people, and a profession 
that values competency within its people. The best of assessment and accountability ef¬ 
forts emphasize systematic self-study for the purpose of improving practices that result in 
greater levels of student learning and success. Comprehensive assessment efforts that aim 
to close the loop between sclf-studv and improving practice must consider the knowledge, 
skill, and dispositional competencies of the educators who design learning interventions for 
students, both within and outside the classroom. Ongoing research and scholarly discourse 
regarding the scope and content of competencies will continue to be critical as the student 
affairs profession intentionally designs and implements professional preparation programs 
and professional development to educate the people who work so diligently to promote ac¬ 
cess, equity, and overall student success within higher education. 
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